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Abstract: Electromagnetic (EM) based optimization and design closure is an essential 
part of RF and microwave design cycle. The main objective of this thesis is to develop 
a new gradient based EM optimization technique which exploits parallel computations. 
The proposed EM optimization technique achieves speed up in the optimization process 
even if a coarse model is not available. Speed up in optimization has been achieved by 
using large and effective optimization updates in each iteration which resulted in fewer 
optimization iterations. The first contribution of the thesis is the development of a trust- 
region based optimization technique which uses parallel computational approach. In the 
proposed method, we deliberately increase the number of fine model evaluations 
without increasing the computation time by using a parallel computational approach. A 
large number of fine model evaluations allows us to build a surrogate model valid in a 
large neighborhood. These valid surrogate models are used to achieve large and effective 
optimization updates. The second major contribution of the thesis is the EM 
optimization decomposition approach to address the challenges in EM optimization with 
many design variables. This proposed method decomposes a single large EM 
optimization problem into multiple smaller sub-optimizations to improve the 
optimization efficiency. Multiple sub-optimizations are formulated to be independent so 
that the parallel computations can be exploited to evaluate concurrent sub-optimization 
updates. The resultant vector, a combined vector of sub-optimization updates, will be 
closer to the optimal solution. Furthermore, the optimization update of the proposed 
approach is much larger in comparison with the optimization update without 
decomposition. 


Keywords: Decomposition, electromagnetic (EM) optimization, gradient optimization, 


microwave filter, parallel, sub-optimization, surrogate model, trust region. 


Click here to read thesis: 


References: 


[1] M. B. Steer, J. W. Bandler, and C. M. Snowden, “Computer-aided design of RF and 
microwave circuits and systems,” [EEE Trans. Microw. Theory Techn., vol. 50, no. 3, pp. 
996-1005, Mar. 2002. 


[2] H. Wu and A. Cangellaris, “A finite-element domain-decomposition methodol- ogy for 
electromagnetic modeling of multilayer high-speed interconnects,” JEEE Trans. Adv. Packag., 
vol. 31, no. 2, pp. 339-350, May 2008. 


[3] Y. Liu and J. Yuan, “A finite element domain decomposition combined with algebraic 
multigrid method for large-scale electromagnetic field computation,” IEEE Trans. Magn., 


vol. 42, no. 4, pp. 655-658, Apr. 2006. 


[4] M. Xue and J. Jin, “A hybrid conformal/nonconformal domain decomposi- tion method 
for multi-region electromagnetic modeling,” JEEE Trans. Antennas Propag., vol. 62, no. 4, 
pp. 2009-2021, Apr. 2014. 


*This use of this work is restricted solely for academic purposes. The author of this work owns the 
copyright and no reproduction in any form is permitted without written permission by the author. * 


[5] G. Scotti, P. Tommasino, and A. Trifiletti, “MMIC yield optimization by design centering 
and off-chip controllers,’ JET Proc. Circuits, Devices and Syst., vol. 152, no. 1, pp. 54-60, 
Feb. 2005. 


[6] S. Koziel and J. W. Bandler, “Rapid yield estimation and optimization of mi- crowave 
structures exploiting feature-based statistical analysis,’ JEEE Trans. Microw. Theory 


Techn., vol. 63, no. 1, pp. 107-114, Jan. 2015. 


[7] J. S. Ochoa and A. C. Cangellaris, “Random-space dimensionality reduction for expedient 
yield estimation of passive microwave structures,” IEEE Trans. Microw. Theory Techn., 
vol. 61, no. 12, pp. 4313-4321, Dec. 2013. 


[8] R. Biernacki, S. Chen, G. Estep, J. Rousset, and J. Sifri, “Statistical analysis and yield 
optimization in practical RF and microwave designs,” in IEEE MTT-S Int. Microw. Symp. 
Dig., Montreal, QC, Canada, Jun. 2012, pp. 1-3. 


[9] Y. Cao, J. J. Xu, V. K. Devabhaktuni, R. T. Ding, and Q. J. Zhang, “An adjoint dynamic 
neural network technique for exact sensitivities in nonlinear transient modeling and high- 
speed interconnect design,” in IEEE MTT-S Int. Microw. Symp. Dig., PA, Philadelphia, 
Jun. 2003, pp. 165-168. 


[10] T. Liu, S. Boumaiza, and F. M. Ghannouchi, “Dynamic behavioral modeling of 3G power 
amplifier using real-valued time-delay neural networks,” IEEE Trans. Microw. Theory 


Techn., vol. 52, no. 3, pp. 1025-1033, Mar. 2004. 


[11] M. Isaksson and D. W. Ronnow, “Wide-band dynamic modeling of poweram- plifiers using 
radial-basis function neural networks,” [EEE Trans. Microw. The- ory Techn., vol. 53, no. 11, 
pp. 3422-3428, Nov. 2005. 


[12] B. O’Brien, J. Dooley, and T. J. Brazil, “RF power amplifier behavioral mod- eling using 
a globally recurrent neural network,” in JEEE MTT-S Int. Microw. Symp. Dig., San 
Francisco, CA, Jun. 2006, pp. 1089-1092. 


[13] D. Schreurs, J. Wood, N. Tufillaro, L. Barford, and D. E. Root, “Construc- tion of 
behavioral models for microwave devices from time domain large signal measurements to 
speed up high-level design simulations," Int. J. RF Microw. Comput.-Aided Eng., vol. 13, 
no. 1, pp. 54-61, Jan. 2003. 


[14] H. Sharma and Q. J. Zhang, “Automated time domain modeling of linear and nonlinear 
microwave circuits using recurrent neural networks,” Int. J. RF Microw. Comput.-Aided 


Eng., vol. 18, no. 3, pp. 195-208, May 2008. 


[15] S. A. Sadrossadat, Y. Cao, and Q. J. Zhang, “Parametric modeling of mi- crowave 
passive components using sensitivity-analysis-based adjoint neural- network technique,” 


IEEE Trans. Microw. Theory Techn., vol. 61, no. 5, pp. 1733-1747, May 2013. 


[16] S. Koziel, S. Ogurstov, Q. S. Cheng, and J. W. Bandler, “Rapid electromagnetic- 


based microwave design optimization exploiting shape- preserving response prediction 


and adjoint sensitivities,” JET Trans. Antennas Propag., vol. 8, no. 10, pp. 775-781, Feb. 
2014. 


[17] M. Ghassemi, M. Bakr, and N. Sangary, “Antenna design exploiting adjoint sensitivity- 
based geometry evolution,” JET Trans. Antennas Propag., vol. 7, no. 4, pp. 268-276, Jan. 
2013. 


[18] V. M. R. Gongal-Reddy, S. Zhang, C. Zhang, and Q. J. Zhang, “Parallel com- putational 
approach to gradient based EM optimization of passive microwave circuits," IEEE Trans. 


Microw. Theory Techn., vol. 64, no. 1, pp. 44-59, Jan. 2016. 


[19] V. M. R. Gongal-Reddy, F. Feng, C. Zhang, S. Zhang, and Q. J. Zhang, "Par- allel 
decomposition approach to gradient based EM optimization," JEEE Trans. Microw. Theory 
Techn., Feb. 2016 (submitted). 


[20] J. W. Bandler, and S. H. Chen, "Circuit optimization: the state of the art," 
IEEE Trans. Microw. Theory Techn., vol. 36, no. 2, pp. 424-443, Feb. 1988. 


[21] J. W. Bandler, W. Kellermann, and K. Madsen, “A superlinearly convergent minimax 
algorithm for microwave circuit design," JEEE Trans. Microw. Theory Techn., vol. 33, no. 
12, pp. 1519-1530, Dec. 1985. 


[22] J. W. Bandler, Q. S. Cheng, S. A. Dakroury, A. S. Mohamed, M. H. Bakr, 
K. Madsen, and J. Sondergaard, “Space mapping: The state of the art,” JEEE Trans. 
Microw. Theory Techn., vol. 52, no. 1, pp. 337-361, Jan. 2004. 


[23] J. W. Bandler, R. M. Biernacki, S. H. Chen, R. H. Hemmers, and K. Mad- sen, 
“Electromagnetic optimization exploiting aggressive space mapping,” JEEE Trans. Microw. 
Theory Techn., vol. 43, no. 12, pp. 2874-2882, Dec. 1995. 


[24] J. W. Bandler, Q. S. Cheng, N. K. Nikolova, and M. A. Ismail, “Implicit space mapping 
optimization exploiting preassigned parameters,” JEEE Trans. Microw. Theory Tech., vol. 52, 
no. 1, pp. 378-385, Jan. 2004. 


[25] J. W. Bandler, M. A. Ismail, and J. E. Rayas-Sanchez, "Expanded space- mapping 
EM-based design framework exploiting preassigned parameters," JEEE Trans. Circuits Syst. I, 


Fundam. Theory Appl., vol. 49, no. 12, pp. 1833-1838, Dec. 2002. 


[26] J. W. Bandler, Q. S. Cheng, D. H. Gebre-Mariam, K. Madsen, F. Pedersen, and 
J. Sondergaard, “EM-based surrogate modeling and design exploiting implicit, frequency 


and output space mappings,” in IEEE MTT-S Int. Microw. Symp. Dig., Philadelphia, PA, 
Jun. 2003. 


[27] J. W. Bandler, D. M. Hailu, K. Madsen, and F. Pedersen, “A space map- ping 
interpolating surrogate algorithm for highly optimized EM-based design of microwave 


devices,” IEEE Trans. Microw. Theory Techn., vol. 52, no. 11, pp. 2593-2600, Nov. 2004. 


[28] J. Meng, S. Koziel, J. W. Bandler, M. H. Bakr, and Q. S. Cheng, “Tuning space 
mapping: A novel technique for engineering design optimization,” in EEE MTT-S Int. Microw. 


Symp. Dig.,, Atlanta, Georgia, Jun. 2008, pp. 991-994. 


[29] S. Koziel and J. W. Bandler, *Space-mapping with adaptive response correc- tion for 
microwave design optimization,” IEEE Trans. Microw. Theory Techn., vol.57, no. 2, pp. 
478-486, Feb. 2009. 


[30] C. Zhang, Feng Feng, and Q. J. Zhang, “EM optimization using coarse and fine mesh 
space mapping,” in Proc. Asia-Pacific Microw. Conf., Seoul, Korea, Dec. 2013, pp. 824- 
826. 


[31] S. Koziel, Q. S. Cheng, and J. W. Bandler, “Space mapping,” IEEE Microw. 
Mag., vol. 9, no. 6, pp. 105-122, Dec. 2008. 


[32] N. M. Alexandrov, J. E. Dennis Jr., R. M. Lewis, and V. Torczon, “A trust- region 
framework for managing the use of approximation models in optimiza- tions,” Struct. 


Optim., vol. 15, no. 1, pp. 16-23, Feb. 1998. 


[33] N. M. Alexandrov and R. M. Lewis, “An overview of first-order model man- agement for 


engineering optimization," Optim. Eng., vol. 2, no. 4, pp. 413-430, Dec. 2001. 


[34] N. M. Alexandrov, R. M. Lewis, C. R. Gumbert, L. L. Green, and P. A. Newman, 
"Approximation and model management in aerodynamic optimiza- tion with variable-fidelity 


models," J. of Aircraft, vol. 38, no. 6, pp. 1093-1101, Dec. 2001. 


[35] R. Ben Ayed, J. Gong, S. Brisset, F. Gillon, and P. Brochet, “Three-level output 


space mapping strategy for electromagnetic design optimization," [EEE Trans. Magn., vol. 


48, no. 2, pp. 671-674, Feb. 2012. 


[36] S. Koziel, J. W. Bandler, and Q. S. Cheng, “Constrained parameter extraction for 
microwave design optimization using implicit space mapping,” JET Microw., Antennas Prop., 


vol. 5, no. 10, pp. 1156-1163, Jul. 2011. 


[37] S. Koziel, S. Ogurtsov, J. W. Bandler, and Q. S. Cheng, “Reliable space- mapping 
optimization integrated with EM-based adjoint sensitivities,” JEEE Trans. Microw. Theory 
Techn., vol. 61, no. 10, pp. 3493-3502, Oct. 2013. 


[38] S. Koziel, Q. S. Cheng, and J. W. Bandler, “Fast EM modeling exploiting shape- 
preserving response prediction and space mapping,” IEEE Trans. Microw. Theory Techn., vol. 
62, no. 3, pp. 399-407, Mar. 2014. 


[39] Q. J. Zhang, K. C. Gupta, and V. K. Devabhaktuni, “Artificial neural networks for RF and 
microwave design — From theory to practice,” IEEE Trans. Microw. Theory Techn., vol. 51, 
no. 4, pp. 1339-1350, Apr. 2003. 


[40] J. E. Rayas-Sanchez, “EM-based optimization of microwave circuits using ar- tificial 
neural networks: The state-of-the-art,” IEEE Trans. Microw. Theory Techn., vol. 52, no. 
1, pp. 420-435, Jan. 2004. 


[41] V. K. Devabhaktuni, M. C. E. Yagoub, Y. Fang, J. J. Xu, and Q. J. Zhang, “Neural 
networks for microwave modeling: Model development issues and non- linear modeling 


techniques,” Int. J. RF Microwave Computer-Aided Eng., vol. 11, pp. 4-21, Jan. 2001. 


[42] V. Rizzoli, A. Costanzo, D. Masotti, A. Lipparini, and F. Mastri, “Computer- aided 
optimization of non-linear microwave circuits with the aid of electromag- netic simulation,” 


IEEE Trans. Microw. Theory Techn., vol. 52, no. 1, pp. 362- 377, Jan. 2004. 


[43] M. Joodaki and G. Kompa, “A systematic approach to a reliable neural model for pHEMT 
using different numbers of training data,” in IEEE MTT-S Int. Microwave Symp. Dig., 
Seattle, WA, Jun. 2002, pp. 1105-1108. 


[44] P. Burrascano and M. Mongiardo, “A review of artificial neural networks appli- cations in 
microwave CAD,” Int. J. RF Microwave Computer-Aided Eng., vol. 9, pp. 158-174, May 
1999. 


[45] P. M. Watson, K. C. Gupta, and R. L. Mahajan, “Development of knowledge based 
artificial neural networks models for microwave components," in IEEE MTT-S Int. 


Microwave Symp. Dig., Baltimore, MD, Jun. 1998, pp. 912. 


[46] F. Wang, and Q. J. Zhang, “Knowledge based neuromodels for microwave design," 


IEEE Trans. Microwave Theory Techn., vol. 45, pp. 2333-2343, Dec. 1997. 


[47] M. H. Bakr, J. W. Bandler, M. A. Ismail, J. E. Rayas-Snchez, and Q. J. Zhang, 
"Neural space-mapping optimization for EM-based design," IEEE Trans. Microw. Theory 
Techn., vol. 48, no. 12, pp. 2307-2315, Dec. 2000. 


[48] L. Zhang, J. Xu, M. C. E. Yagoub, R. Ding, and Q. J. Zhang, "Efficient ana- lytical 
formulation and sensitivity analysis of neuro-space mapping for nonlinear microwave device 


modeling,” IEEE Trans. Microw. Theory Techn., vol. 53, no. 9, pp. 2752-2767, Sep. 2005. 


[49] D. Gorissen, L. Zhang, Q. J. Zhang, and T. Dhaene, “Evolutionary neuro-space mapping 
technique for modeling of nonlinear microwave devices,’ [EEE Trans. Microw. Theory 


Techn., vol. 59, no. 2, pp. 213-229, Feb. 2011. 


[50] H. El-Rewani, and M. Abd-El-Barr, Advanced Computer Architecture and Par- allel 
Processing, Hoboken, NJ, John Wiley & Sons, 2005. 


[51] MPI: A Message-Passing Interface Standard, version. 2.2, Message Passing Interface 
Forum, sep. 2009. 


[52] OpenMP Application Interface, version. 3.1, OpenMP Architecture Review Board, Jul. 
2011. 


[53] P. Pacheco, An Introduction to Parallel Programming, San Francisco, CA: Mor- gan 


Kaufmann, 2011. 


[54] J. Zhang, K. Ma, F. Feng, and Q. J. Zhang, “Parallel gradient-based local search 
accelerating particle swarm optimization for training microwave neural network models,” 


IEEE MTT-S Int. Microw. Symp. Dig., Phoenix, Arizona, USA, May 2015. 


[55] L. Zhang, Y. Cao, S. Wan, H. Kabir, and Q. J. Zhang, “Parallel automatic model 


generation technique for microwave modeling,” in IEEE MTT-S Int. Mi- crow. Symp. Dig., 


Honolulu, Hawaii, Jun. 2007, pp. 103-106. 


[56] S. Koziel, and J. W. Bandler, “Space mapping with distributed fine model evaluation 
for optimization of microwave structures and devices,’ inJEEEMTT- S Int. Microw. Symp. 
Dig., Atlanta, GA, USA, Jun. 2008, pp. 1377-1380. 


[57] S. Koziel, and J. W. Bandler, “Distributed fine model evaluation for rapid space- 
mapping optimization of microwave structures,” JET Microw. Antennas Propag., vol. 3, no. 


5, pp. 798-807, Aug. 2009. 


[58] Feng Feng, C. Zhang, V.-M.-R.- Gongal-Reddy, Q. J. Zhang, and J. Ma, “Paral- lel space- 
mapping approach to EM optimization," JEEE Trans. Microw. Theory Techn., vol. 62, no. 5, 
pp. 1135-1148, May 2014. 


[59] J. M. Johnson and V. Rahmat-Samii, “Genetic algorithms in engineering elec- 


tromagnetics," JEEE Trans. Antennas Propag., vol. 39, no. 4, pp. 7-21, Aug 1997. 


[60] G. Crevecoeur, P. Sergeant, L. Dupre, and R. Van de Walle, “A two-level genetic 
algorithm for electromagnetic optimization,” IEEE Trans. Magn., vol. 46, no. 7, pp. 2585- 
2595, Jul. 2010. 


[61] C. M. Coleman, E. J. Rothwell, and J. E. Ross, “Investigation of simulated annealing, 
ant-colony optimization, and genetic algorithms for self-structuring antennas,” IEEE Trans. 


Antennas Propag., vol. 52, no. 4, pp. 1007-1014, Apr. 2004. 


[62] S. S. Rao, Engineering Optimization, NJ, John Wiley & Sons, 1996. 


[63] S. Koziel, Simulation-Driven Design Optimization and Modeling for Microwave 


Engineering, Imperial College Press, 2013. 


[64] V. Gongal-Reddy, S. Zhang, Y. Cao, and Q. J. Zhang, “Efficient design opti- mization of 
microwave circuits using parallel computational methods,” inProc. 7th Eur. Microw. Integr. 
Circuits Conf., Amsterdam, NL, Oct. 2012, pp. 254- 257. 


[65] S. Koziel, J. W. Bandler, and Q. S. Cheng, “Robust trust-region space-mapping algorithms 
for microwave design optimization," [EEE Trans. Microw. Theory Techn., vol. 58, no. 8, 
pp. 2166-2174, Aug. 2010. 


[66] P. M. Watson, and K. C. Gupta, *EM-ANN models for microstrip vias and interconnects 
in dataset circuits," IEEE Trans. Microw. Theory Techn., vol. 44, no. 12, pp. 2495-2503, 
Dec. 1996. 


[67] N. K. Nikolova, J. Zhu, D. Li, M. H. Bakr, and J. W. Bandler, “Sensitivity analysis of 
network parameters with electromagnetic frequency-domain simula- tors,” IEEE Trans. 


Microw. Theory Techn., vol. 54, no. 2, pp. 670-681, Feb. 2006. 


[68] Y. Cao, G. Wang, and Q. J. Zhang, “A new training approach for parametric modeling of 
microwave passive components using combined neural networks and transfer functions,” IEEE 


Trans. Microw. Theory Techn., vol. 57, no. 11, pp. 2121-2742, Nov. 2009. 


[69] B. Gustavsen, and A. Semlyen, “Rational approximation of frequency domain responses by 


vector fitting,” IEEE Trans. Power Delivery, vol. 14, no. 3, pp. 1052-1061, Jul. 1999.. 


[70] B. Gustavsen, “Improving the pole relocating properties of vector fitting,” 


IEEE Trans. Power Delivery, vol. 21, no. 3, pp. 1587-1592, Jul. 1999. 


[71] D. Deschrijver, M. Mrozowski, T. Dhaene, and D. De Zutter, “Macromodeling of multiport 
Systems using a fast implementation of the vector fitting method,” IEEE Microw. and 


Wireless Components Lett., vol. 18, no. 6, pp. 383-385, Jun 2008. 


[72] Z. Kang, “An analytical pascal matrix transform for s-to-z domain transfer functions,” 


IEEE Signal Process. Lett., vol. 13, no. 10, pp. 597-600, Oct. 2006. 


[73] J. V. Morro, P. Soto, H. Esteban, V. E. Boria, C. Bachiller, M. Taroncher, 
S. Cogollas, and B. Gimeno, “Fast automated design of waveguide filter using aggressive 
spacemapping with a new segmentation strategy and a hybrid opti- mization algorithm,” 


IEEE Trans. Microw. Theory Techn., vol. 53, no. 4, pp. 1130-1142, Apr. 2005. 


[74] Y. F. Ruan, Y. X. Guao, and X. Q. Shi, “Double annular-ring dielectric res- onator 
antenna for ultra-wideband application,” IEEE Microw. and Opt. Techn. Lett., vol. 49, no. 2, 
pp. 362-366, Feb. 2007. 


[75] M. Lapierre, Y. Antar, A. Ittipiboon, and A. Petosa, “Ultra wideband 
monopole/dielectric resonator antenna,” IEEE Microw. and Wireless Compo- nents Lett., 


vol. 15, no. 1, pp. 7-9, Jan. 2005 


[76] C. Ozzaim, “Monopole antenna loaded by a stepped-radius dielectric ring res- onator for 
ultrawide bandwith,” JEEE Antennas and Wireless Propag. Lett., vol. 10, pp. 843-845, Aug. 
2011. 


[77] C. Zhang, F. Feng, V. M. R. Gongal-Reddy, Q. J. Zhang, and J. W. Bandler, “Cognition- 
driven formulation of space mapping for equal-ripple optimization of microwave filters,” 


IEEE Trans. Microw. Theory Techn., vol. 63, no. 7, pp. 2154-2165, Jul. 2015. 


[78] L. O. Chua and L. K. Chen, “Diakoptic and generalized hybrid analysis," IEEE Trans. 
Circuits Syst., vol. 23, no. 12, pp. 694-705, Dec. 1976. 


[79] F. Wu, “Solution of large-scale networks by tearing," JEEE Trans. Circuits Syst., vol. 
23, no. 12, pp. 706-713, Dec. 1976. 


[80] S. Liao, H. Kabir, Y. Cao, J. Xu, Q. J. Zhang, and J. Ma, “Neural-network modeling 
for 3-D substructures based on spatial EM-field coupling in finite- element method,” IEEE 
Trans. Microw. Theory Techn., vol. 59, no. 1, pp. 21-38, Jan. 2011. 


[81] H. Kabir, Y. Wang, M. Yu, and Q. J. Zhang, “High-dimensional neural-network technique 
and applications to microwave filter modeling,” IEEE Trans. Microw. Theory Techn., vol. 58, 
no. 1, pp. 145-156, Jan. 2010. 


[82] Z. Lu, X. An, and W. Hong, “A fast domain decomposition method for solving three- 
dimensional large-scale electromagnetic problems,” JET Microw. Antennas Propag., vol. 56, 
no. 8, pp. 2200-2210, Aug. 2008. 


[83] Y. Cao, S. Reitzinger, and Q. J. Zhang, “Simple and efficient high-dimensional parametric 
modeling for microwave cavity filters using modular neural network,” IEEE Microw. and 


Wireless Components Lett., vol. 21, no. 5, pp. 258-260, May 2011. 


[84] F. Van den Bergh and A. P. Engelbrecht, “A cooperative approach to particle swarm 
optimization,” [EEE Trans. Evol. Comput., vol. 8, no. 3, pp. 225-239, Jun. 2004. 


[85] J. W. Bandler and Q. J. Zhang, “An automatic decomposition approach to optimization 
of large microwave systems,” [EEE Trans. Microw. Theory Techn., vol. 35, no. 12, pp. 1231- 
1239, Dec. 1987. 


[86] Y. J. Wei, Q. J. Zhang, and M. S. Nakhla, “Multilevel optimization of high- speed VLSI 
interconnect networks by decomposition," IEEE Trans. Microw. Theory Techn., vol. 42, 


no. 9, pp. 1638-1650, Sep. 1994. 


[87] Z. Yang, K. Tang, and X. Yao, “Large scale evolutionary optimization using cooperative 
co-evolution,” Information sciences, vol. 178, pp. 2985-2999, Aug. 
2008. 


[88] M.N. Omidvar, X. Li, and X. Yao, “Cooperative co-evolution with 
delta group- ing for large scale non-separable function optimization,” in 
Proc. IEEE Congress Evol. Comput., Barcelona, Spain, Jul. 2010, pp. 
1762-1769. 





M 


[89] M. N. Omidvar, X. Li, Y. Mei, and X. Yao, Cooperative co-evolution with differential 
grouping for large scale optimization," JEEE Trans. Evol. Comput., vol. 18, no. 3, pp. 378- 
393, Jun. 2014. 


[90] N. K. Georgieva, S. Glavic, M. H. Bakr, and J. W. Bandler, “Feasible adjoint sensitivity 
technique for EM design optimization," EEE Trans. Microw. Theory Techn., vol. 50, no. 12, 
pp. 2751-2758, Dec. 2002. 


[91] F. Feng, C. Zhang, J. Ma, and Q. J. Zhang, “Parametric modeling of EM behavior of 
microwave components using combined neural networks and pole- residue-based transfer 


functions,” JEEE Trans. Microw. Theory Techn., vol. 64, no. 1, pp. 60-77, Jan. 2016. 


[92] Q. J. Zhang, NeuroModeler plus, Dept. of Electronics, Carleton University, Ottawa, 
Canada, 2005. 
[93] HFSS. Ver. 15, ANSYS Corporation, Canonsburg, PA, 2013. 


Venu-Madhav-Reddy Gongal-Reddy was born in Hyderabad, India, on May 9, 1985. He received 
the B.Eng. degree from Jawaharlal Nehru Technological University, Hyderabad, India, in 2006, 


the M.S.(Tech) degree in radio frequency and microwave engineering from Indian Institute of 


Technology (IIT) Kharagpur University, India, in 2008 and his Ph.D. degree in Electronics at 


Carleton University, Ottawa, ON, Canada, in 2016. 


His research interests include EM design, antenna design, Multiphysics models, surrogate 
modeling, and developing new optimization techniques for faster turnaround cycle for high 


frequency circuits, devices and systems. 


Parallel Computational 
Approach to Gradient based EM 
Optimization of Microwave 
Structures 


Venu Madhav Reddy Gongal-Reddy 


Advisor-Prof. Q. J. Zhang 





Faculty of 
Engineering 
and Design 





Sa Carleton 


WY UNIVERSITY 





Outline 


© Introduction 

© Existing Techniques 

© Proposed Optimization —I 
© Proposed Optimization -H 
© Future Directions 





Motivation 


^» EM based simulation and optimization - more important 
for microwave design. 


> Repetitive changes to geometrical parameters such as 
length & width to find the optimal design parameters. 


>» Huge computational cost and large CPU time. 


>» EM complexity, stringent design specifications and 
shorter design cycle — faster, accurate and automated. 
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Existing Techniques 


^ Direct EM optimization 


^ Space mapping — surrogate based optimization technique 
^ Fewer fine model evaluations 
^ Exploits coarse models (empirical or equivalent circuits) 
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^ Coarse and fine mesh space mapping — no equivalent 


circuits 
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Objective 


^» Speed up EM optimization. 
^ Exploit parallel computation power 
^ Large CPU time for EM optimization- needs to addressed 
> Our goal is to formulate a methodology that 
» exploits parallel computation, 
> uses gradient based optimization method (faster) 
» and achieve speed up in the optimization technique. 


» Applicable when no coarse models are available. 





Optimization Problem Definition 
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^ Original optimization problem inm 
"" 
x* — arg minU (R, (x, o)) 
Where x denotes the design vector containing geometrical design variables 
R,(x,0) denotes the response of the fine model, and 
U represents the objective function. 
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Concept 


Design Space Design Space 


optimization 
update step 
size 


Xr 





Lo xi(L) 


Large region or small region ?? 


Guaranteed Convergence ?? 





Orthogonal Array Sampling in the Trust 
Region for 3 Design Variables 


. ; JM T 
Design variables :x - [ x, x; ... x,] fx! x? ja? 


- set of sampled points 


Central 
point moves x ^ for the next 
iteration 


x ^ for the current 
iteration 


Central point in the current iteration. 


Trust Region À 8 = Ix Xj-0, £x, S xj *Ó; 


where j =1,2,---,n} 





Parallel Computation 


^ Implemented on hybrid distributed-shared memory architecture. 
Distribute the data samples. 
Perform fine model evaluations such that each processor performs one EM 


simulation (one fine model evaluation). 


{R,(x",@)|m=1,2,---,N,} 


Speed up Parallel efficiency 


N, 
T, T OT, T l; J 
S = m=l 7] — 1 


P 


P ISm=N, 


| T. d max 1T, | +T, «T, Ji. 


^ Max Parallel efficiency - minimizing overhead CPU time and surrogate model 
generation and optimization CPU time per iteration 





Surrogate Modeling using Multiple Points 


^ Transfer functions are used for constructing the surrogate. 


> The surrogate model response Rf, (x^, s) 


R, (x, ©) 


M 
aj z 
R,(x^,2)— = 
1+ > Bez 
Interface k=1 
coefficients 
a & f 


a” =g, (ÅA, x") 





Finding Weighting Vectors 


^ The new weighting vectors 


E(À,0) - R,(x",0)-R, a”, o) 


Weighting vector, A 


Optimize weighting 
vectors 


A = emi ( Y Y E, Q) 


oeQ m=1 





Optimization Update and Trust Radius Update 


> Surrogate model optimization update x "" — arg minU (R, (x, c») 
xeX, 


^ Verify, x"*" is the new prospective update or not, 


r ——], if U (R,(x"",0)) 2 U(R, Qt, 0)) 


U(R,(x°,@))-U(R,(x"",@)) ; 


Termination Conditions 


Y e C 


Ô, 0.1 
ae U(R,(x"",@))<0 
Trust radius 6” =4min(c,oô, A), r, >0.75 


update Ô , Otherwise 
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Four Pole Waveguide Example 


Design Specifications : IIS, Il < -25dB for 10.85GHz < @ < 11.15GHZ 


Case 1: Good Starting Point Case 2: Bad Starting Point 


Starting point x° = [3.3 4.4 4.0 3.28 2.91]! x° = [3.0 4.1 3.5 3.3 3.0]! 


Initial trust radius : ó 2 [0.132 0.176 0.16 0.0656 0.0582]! (in mm) which is [4 4 4 2 2] |? 


Maximum trust radius -A™* 2 [0.132 0.176 0.16 0.0656 0.0582]! (in mm) 


13 





Comparison of Different Optimization 
Methods for a Good Starting Point 


Starting point 
for all Optimizations 
10.85 11.15 








Frequency, GHz 
(a) 


Coarse and fine mesh 
SM method: Iteration 4 
10.85 11.15 1145 


Frequency, GHz 
(c) 








0 





Direct EM Optimization: 
Iteration 144 








10.55 





10.85 11.15 1145 
Frequency, GHz 
(b) 


Proposed Optimization: 
Iterationi4 








10.55 


10.85 11.15 1145 
Frequency, GHz 
(d) 





Comparison of Different Optimization 
Methods for a Bad Starting Point 


0 


Starting point 
for all Optimizations 
0.55 10.85 11.15 


Frequency, GHz 
(a) 





Coarse and fine mesh 
SM method: Iteratipn 2 


10.55 10.85 11.15 11.45 
Frequency, GHz 


(c) 








Direct EM Optimization: 








10.55 





10.85 11.15 11.45 
Frequency, GHz 
(b) 


Iteration 8 








0,555 


10.85 11.15 11.45 
Frequency, GHz 
(d) 





CPU Time Comparison of Different 
Optimization methods for a Bad Starting Point 


Direct EM Coarse and fine mesh | Proposed 
Optimization 
optimization | SM optimization optimization 


Fine model evaluation Drs 2m 30s 
time per sample 


No. of fine model 
evaluations in parallel 25 
per iteration 


No. of iterations D 


No. of coarse model 


evaluations se 


Time for each coarse 


model evaluation 27s _ 


36.86m+2.82m 


Total time 28h 19m 242.95m —39 69m 





c 
2 
© 
È 
Be 
o 
= 
9 
Z 
a 
O 
w 
o 
o 
3 
© 
> 


Objective Function Value Comparison 


Optimization using a Good Starting point 


200- 





sh 

a 

o 
T 


ak 

o 

o 
T 


a 
o 
T 


o 
T 





T T T T 


Tox Æ-Proposed Method 


#-Coarse and fine mesh SM method 


69.65 73.96 





Iteration 


Value of Objective function 





Optimization using a Bad Starting Point 


I I 1 I I 


-©-Proposed Method 


—#- Coarse and fine mesh SM method 


37.83 37.83 37.83 


21.82 45.33 


1 


4 . 
Iteration 





Confirming the Solution from Direct EM 
Optimization is a Local Minima 


Value of objective 
function 


Solution of direct x 
EM optimization aguas 


sample 


= y” + TX" — x^) 


+ve -ve 


Perturbation l f 1 ; 
direction direction 


Perturb x, of x°™ 43.23] 43.950 
Perturb X, of xem 44821 43.709 
Perturb X4 of X 44.587 44.336 


c 
© 
= 
© 
c 
3 
2 
o 
E 
B 
o 
= 
D 
O 
S= 
© 
o 
2 
© 
> 


Perturb x, of x9 49.329 45.609 
Perturb x5 of x^^ 48.220 48.264 











The new solution from one iteration of the proposed optimization jumps the local 
minima solution obtained from direct EM optimization 
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Contributions-I 


> 


The proposed method achieves speedup even 1f a coarse 
model is not available. 


The proposed method deliberately increases the number of 
fine model evaluations without increasing computational 
time by using a parallel computation approach. 


Speed up is achieved by using large and effective 
optimization updates. 





Next Challenge (Increase in n) 


> Major issue - Scalability (w.r.t input design variables) 


> Volume of search space increases as the order of n 


> Increased likelihood of getting trapped in local minima 
using conventional gradient based methods. 


With increase in n the number of possible design 
variations that are needed to predict EM behaviour 
increases which results in the decreased validity range for 
the surrogate model. 





Solution 


| T 
For illustration, suppose x = [x x; | 
Taylor series expansion : 
+B Ka T B.x; 
0° y . 4 
B, = ——— + Second order derivative 
6 -4 -2 0 2 
x 
B, — eccentricity or measure of interaction between the design variables 


B, =0; x, and x, are independent and separable. 


Decomposition of original optimization problem into two smaller sub-opts 


x, =ar min U(R x, © ) x, =ar min U(R X,, © | 
de ; O05 6) 2 5 IDEO 7 5 @) 


x x x T 
Optimal Solution > x =|x A 





Decomposition 


The decomposition method is sub-divided as 


> Measure of interactions (eccentricity) for all design variables (i.e., second 
order derivatives) 


> Iteratively identify strongly interacting design variables. 


» Form the sub-design vectors for further sub-optimization 


Measure of interaction 


Cin 
Ny, 


OS E QR, (X,@,) 


Cap — =>. 


q-l 


Ox, OX, 


nn J nxn 





Identification of strongly Interacting Design 
Variables 


L - number of groups or sub-optimizations . . 
erouP P Design variables 
indices 


Strongly interacting design 
variables are grouped 


Strongest interaction - = 


Cy = ine C,,aegJ, vbeg J, Weak interaction Weak interaction 
a<b£n between groups between groups 


J, KOM, if ket, LET, Ad, < dain) 


Form the i" sub design vector 
J — represents the index set J, = J,Ufk), ifk eJ; ^AleJ; ^(d, «d,,) 


of sub design vector 
J, UI), ifk e J; Al € Ji ^(d, « d.) wie 
la 





Flow Chart 
with Example 


Given L.. and C 


1 ni 


matrix 


101 134 207 15 13 7 5 


76.7 
: 
— 971 407 21 46 43 3720 120 15 uns 


— 1721 53 48 40 30 206 35 Set i=1.J. to null set and X® to 
null vector Wi =1,2.,- ds | 
— 9 13 17 2314 53 12 


— 116 (TS, 26 19 286 28 


— 1 11 4 1 


- 21 Update X? and J, 





replacing the entire rows 
and columns that belong to 
J, with zeros 


= c8 : et i-i 
Update C matrix by 
i i keJ, ale J, d; < d max 


| Index sets for the 
= (al: 6, ED sub design 


J — 18, 9, 1 1] vectors The last group J, and the last sub design 


vector x x 


24 





Parallel Formulation for Sub-optimizations 


Original design vector decomposed into 
L sub design vectors 


Sub- Sub- Sub- 
optimization optimization ... optimization 
Problem- 1 Problem-2 Problem L 


~ u,(L 
| gown 


= u,(1 = u,(2 
x^ o | y” | 


Evaluate fine model responses of prospective updates in 
parallel 





i 


Find the best solution x "^" 


Increment iteration 
number 


| 


Update trust radius 
and the central point 


t 


satisfied? 





Crossover 


» Combining the sub-optimization solution of one subspace with the 
sub-optimization solutions of one or more subspaces. 


» Allows us to directly jump to new optimization update without 
iteratively searching for the optimal solution in redundant search 
spaces. 


» Span the entire optimization space effectively and efficiently. 


T 
Z= [u U w] (Ulo, Vo, Wi) (Ui, Vos Wi) 
S 


0:01) E 


WH: 0/1 7 
E Sub optimization 
update. for. u 


update for wW, 


\ 
Sub optimization 
` 


Sub optimization 


ç UH 0 H] TU 
update for V ia 


(u5,V; Wo) (4,,V,,W0) 





Optimization Update after Crossover using a 
Three Variable Example 


Central point in current iteration Base update vector Crossover update vector 
eU) = fll) 5 BU 
x Uy x 1 x uy 
C2) |_ ze) |. END I ence 
x =| Vo x =| Vo x =| v 


xeo Wo xe Wo FOO) Wo 


The best solution is calculated as 


ZT = arg min U (R, (z, o)) where, Z = ne coe ia 


new 


Optimization update = 7 


| SO ijf y^ c ze 
Trust radius update óc = d E 


5", if x g A 
Termination Conditions 


|r-x""|se or -U(R,(x"",@)) <0 





Example-2 


. . S = T 
Design variables :x = [ ho; hez he3 Fo F, Wg W2 W3 W4 Wa Wol 


-20dB for 703 MHz < œ < 713 MHz and 
5dB for 690 MHz < œ < 701 MHz and 


Design Specifications : IIS, | 
-1 
-15dB for 715 MHz x o < 720 MHz 


| < 
IIS, Il < 
| < 





Comparison of Validity Range of the 
Surrogate Model 


Optimization 


Design 
variables 


Trust radius 
(deviation from 
central point) 


Surrogate 
model training 
error 


Surrogate 
model test error 


29 


Optimization 
method without 
decomposition 


x= US hoz 
hs r, n 
AN 
W4 Wa wy] i 
[0.05 0.05 0.025 
0.05 0.1 0.1 0.1 
0.1 0.1 0.1 0.1]? 


3.56% 


4.5247% 


Optimization method with decomposition 


Sub-optimization | | Sub-optimization 2 


~(1 
ie 


LE ha re ] s 


[0.5 0.24 0.42] * 


3.2274% 


3.954% 


xu 


[Ar 


T 
cl “p Wi wal 


[1.1 2.0 2.0 2.0 1.7] T 


3.2218% 


3.7451% 


Sub-optimization 3 


xe 


[w5 w4 wy ]! 


[1.6 2.0 2.0] * 


3.4281% 





Results of Crossover 


= 193.45 
z 





690 700 710 
Frequency, MHz 


(a) 


= 163.0: 
z 


001 





720 





690 700 710 
Frequency, MHz 


700 710 
Frequency, MHz 
(b) 





720 


700 710 
Frequency, MHz 


in the First Iteration 


= 124.1 
Z 





690 


700 710 720 
Frequency, MHz 


(c) 





700 710 720 
Frequency, MHz 


(d) 


(f) 


, = 103.45 
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700 710 
Frequency, MHz 
(9) 





700 710 720 
Frequency, MHz 


(h) 





Comparison of Different Optimization 
Methods 


Starting point 








for all optimizations 





Direct EM optimization: 
Iteration 638 











700 710 
Frequency, MHz 


(a) 


700 710 
Frequency, MHz 
(b) 


Coarse and fine mesh 
SM method: Iteration 5 





700 710 
Frequency, MHz 


(c) 


decomposition: Iteration 6 











700 710 
Frequency, MHz Frequency, MHz 


(d) (e) 





CPU Time Comparison 


Optimization 


Time for derivative 
calculations 


Fine model evaluation 
time per sample 


No. of fine model 
evaluations in parallel 
per iteration 


No. of iterations 


Evaluation time for all 
fine models 


Time for surrogate 
modeling and 
optimization 


No. of coarse models 


Time for each coarse 
model evaluation 


Total time 


32 


Direct EM 
optimization 


11m 32s 


638 


11.5m x 638 


Coarse and fine 
mesh SM 
optimization 


11m 32s 


5 


11.53m x (5+1) 


Opt. Method 
without 
decomposition 


13m 16s 
(1st order) 


13m 16s 


98 


13 


13.27m x (13+1) 


3.1m x 13 


309.73m 


Proposed 
optimization with 
decomposition 


29m 28s 
(1st &2"4 order) 


13m 16s 
25+25+16 
6 

13.27m x 6 


+ 13.27m x 6 


2m x 6 


200.54m 





Objective Value Comparison 














With decomposition 
== Without decomposition 


. -© Proposed optimization with decomposition 
#- Coarse and fine mesh SM method 

















93-44 169.7 171.13 


135.2 134.37 


c 
2 
+ 

o 

c 

=d 
LL 

© 
= 
© 
2, 
a 
O 
— 

o 

o 
3 

(0 
> 


Value of Objective Function 




















Iteration 





Contribution-II 


^ The proposed method decomposes a single large optimization 
into multiple smaller sub-optimizations to improve 
optimization efficiency 


Construction of surrogate model and optimization of each sub- 
problem are performed in parallel. 


Speed up is achieved by using the proposed decomposition 
method combined with parallel computations. 


Has better chance of avoiding local minima by incorporating 
crossover mechanism in the optimization process. 
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Future Directions 


^ Explore the optimization efficiency for large number of 
design variables (n>20) 


^ Higher order regression techniques. 


> Use of co-ordinate rotation to reduce the interactions 
between design variables. 


> Yield-driven optimization. 


^ Use of the proposed parallel approach for active 
circuit design. 





THANK YOU 





